
FIG. 1B 
Conventional Art 




2/11 



I.3 
<iB 

hi) 
O 
\'u 

i.fi 
Lrl 



130 



135 



Scene Change 
Detector 



Temporal Bit 
Allocator 



140 



Rate Controller 



Visual Object 



145 



Pre- 
processing 
Filter 



-150 





Visual 
Object 
Encoder 


— ►! 


► 






155 



-160 



Audio 



Audio Encoder 



FIG. 1C 



170 




172 



Visual Object 
decoder 



r 



177 



Post- 
Processing 
Filter 



Audio/Visual 
Object System 
De-Multiplexer 



182 



Audio 
Decoder 



FIG. 1D 



r 



165 



AudioA/ideo 

System 
Multiplexer 




175 



Display Size 
Selector 



XL 



180 



Visual Object 
Renderer 



-185 



Audio Output 
Device 



3/11 



Start Optimum Display 
Size Calculation 
(At Encoder)and 
Rendering Process 




200A 



205A 



Encode Visual Object 



21 OA 



For each frame/ set of frames /sample 
of frames from original Visual Object, 
Calculate Coding difficulty value as a 
function of Signal-to-Noise Ratio 



1 



235A 



Display Visual Object with 
Calculated Optimum Display 
Size 



240A 



Yes 



215 



Determine Optimum 
Display size for Visual 

Object Based on 
Coding Difficulty Value 
and Visual 
transmission Rate 



220A 



Forward encoded Visual Object 
and Optimum display size 
value over communications 
medium 



225A 



Decode Received 
Visual Object 



230A 



Display Visual Object 
with Calculated Optimum 



Display Visual Object with 
Default or Selected Display 
Size 



END 



No 



FIG. 2A 




4/11 



Start Optimum Display 
Size Calculation 
(At Decoder)and 
Rendering Process 




200B 



205B 



Encode Visual Object 



210B 



For each frame/ set of frames /sample 
of frames from original Visual Object, 
Calculate Coding difficulty value as a 
function of Signal-to-Noise Ratio 



221 B 



1 



235B 



Display Visual Object with 
Calculated Optimum Display 
Size 



240B 



Yes 



Forward encoded Visual Object 

and Coding Difficulty value 
over communications medium 



225B 



Decode Received 
Visual Object 



227 



Determine Optimum 
Display size for Visual 

Object Based on 
Coding Difficulty Value 
and Visual Object 
transmission Rate 




Display Visual Object with 
Default or Selected Display 
Size 



END 



FIG. 2B 



# 



5/11 



Start Optimum Display 
Size Calculation 
(At Encoder) and 
Rendering Process 




200C 



205C 



Encode Visual Object 



210C 



For each frame/ set of frames /sample 
of frames from original Visual Object, 
Calculate Coding difficulty value as a 
function of Signal-to-Noise Ratio 



216 



235C 



Display Visual Object with 
Calculated Optimum Display 
Size 



240C 



Yes 



Determine Optimum Display size for 
Visual Object Based on Coding 
Difficulty Value 



220C 



Forward encoded Visual Object 
and Optimum display size 
value over communications 
medium 



225C 



Decode Received 
Visual Object 



230C 



Display Visual Object 
with Calculated Optimum 



Display Visual Object with 
Default or Selected Display 
Size 



END 



No 



FIG. 2C 



# 



6/11 



Start Optimum Display 
Size Calculation 
(At Decoder) and 
Rendering Process 




200D 



205D 



Encode Visual Object 



210D 



For each frame/ set of frames /sample 
of frames from original Visual Object, 
Calculate Coding difficulty value as a 
function of Signal-to-Noise Ratio 



1 



235D 



Display Visual Object with 
Calculated Optimum Display 
Size 



240D 



Yes 



220D 



Forward encoded Visual Object 

and Coding Difficulty value 
over communications medium 



Decode 



225D 



Received 



Visual Object 



228 



Determine Optimum Display 
size for Visual Object Based on 
Coding Difficulty Value 



230D 



Display Visual Object 
with Calculated Optimum 
Display Size? 



Display Visual Object with 
Default or Selected Display 
Size 



END 



No 



FIG. 2D 



7/11 



Start Optimum Display 
Size Calculation Routine 



215, 227, 
435 



305 



Ascertain Coding Difficulty Value 



310 

i 

Ascertain Visual Object transmission 
rate 



315 



Map Coding Difficulty Value 
and Visual Object 

transmission rate with chart, 
table, graph, etc. 




320 


Identify zone value 
corresponding to Coding 
Difficulty Value and 
transmission rate 




325 

r 


Associate zone value with 
optimum display size value 




r 



END 



FIG. 3A 



+ 



8/11 



330 



400 



300 



200 



100 



■ Sample Object 1- 
^\ Sample Object 2 
^ Sample Object 3 
@ Sample Object 4 
Q Sample Object 5 
@ Sample Object 6 




Harmonic Average off PSNR 



9/11 



Start Optimum Display 
Size Calculation 
(At Decoder) 
and Rendering Process 



-400A 



405A 



Receive Encoded Visual 
Object 




41 OA 

r 



For each frame/ set of 
frames /sample of frames 
from Visual Object, 
determine average step size 
based on a first transform 
coefficient 



41 5A 



For each frame/ set of 
frames /sample of frames 
from Visual Object, 
determine average step size 
based on a second 
transform coefficient 



420A 



Calculate appropriate 
function for the first and 
second average step size 
sets 



425A 



Derive final step size 
parameter from calculated 
appropriate function 



430A 



Ascertain Coding Difficulty 
value based upon final step 
size parameter 



435 



Determine Optimum 
Display size for Visual 

Object Based on 
Coding Difficulty Value 
and Visual Object TX 
Rate 



440A 



Decode Received 
Encoded Visual 
Object 



445A 




Display Visual Object with 
Calculated Optimum Display 
Size 



455A 



Display Visual Object with 
Default or Selected Display 
Size 



END 



FIG. 



4A 



10/11 



400B 



Start Optimum Display 
Size Calculation 
(At Decoder) and 
Rendering Process 



405B 



Receive Encoded Visual 
Object 



437 



Determine Optimum 
Display size for Visual 
Object Based Visual 
Object transmission 
Rate 



1 



445B 



Display Visual Object with 
Calculated Optimum Display 
Size 



445B 



Yes 



Display Visual Object with 
Default or Selected Display 
Size 



END 



Decode 



440B 



Received 



Visual Object 




11/11 



-400C 



Start Optimum Display 
Size Calculation 
(At Decoder) 
and Rendering Process 



405C 



1 

Receive Enc 
Obj 


:oded Visual 
ect 




41 OC 

r 



For each frame/ set of 
frames /sample of frames 
from Visual Object, 
determine average step size 
based on a first transform 
coefficient 



415C 



For each frame/ set of 
frames /sample of frames 
from Visual Object, 
determine average step size 
based on a second 
transform coefficient 



1 


420C 


Calculate appropriate 
function for the first and 
second average step size 
sets 




425C 

f 


Derive final step size 
parameter from calculated 
appropriate function 



1 



430C 



Ascertain Coding Difficulty 
value based upon final step 
size parameter 



438 



Determine Optimum Display 
size for Visual Object Based 
on Coding Difficulty Value 



440C 



Decode Received 
Encoded Visual 
Object 




Display Visual Object with 
Calculated Optimum Display 
Size 



455C 



Display Visual Object with 
Default or Selected Display 
Size 



END 



FIG. 4C 



